Performance assistance apparatus and method

ABSTRACT

To assist a human player in performing a plurality of foot operators (pedal keys) operable with a human player&#39;s foot, a foot operator image indicative of the foot operators is displayed on a display screen. Model performance data including at least information indicative of a rhythm and a pitch of a foot performance part to be performed by use of the foot operators is acquired, and a particular foot operator corresponding to the pitch of the foot performance part included in the acquired model performance data is visually designated. At the same time, based on rhythm information for the foot performance part, a rhythm of a sound corresponding to the particular foot operator is presented. The presentation of the rhythm is performed by presenting a sound generation timing and a time length of the sound, and a suitable marker indicative of a performance progression may be additionally displayed.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of PCT International Application No.PCT/JP2018/008101, filed Mar. 2, 2018, which claims priority under 35U.S.C. § 119 from Japanese Patent Application No. JP PA 2017-040598,filed Mar. 3, 2017, the entire disclosure of which are hereinincorporated by reference.

BACKGROUND

The embodiments of the present invention relate to a performanceassistance apparatus and method suited for training of a musicperformance.

There have heretofore been known electronic musical instruments thathave a guide function for guiding a user or human player in a musicperformance. Such electronic musical instruments have a key depressionguide function. The electronic keyboard musical instrument includes LEDs(Light Emitting Diodes) provided in corresponding relation to individualkeys of a keyboard. In a guide mode, the LED corresponding to aparticular key to be operated is illuminated in a first style apredetermined time before a key-on timing of the key and illuminated ina second style at the key-on timing.

SUMMARY

Some of the existing electronic musical instruments include, in additionto a manual keyboard operable with hands, a pedal keyboard operable withfeet, as typified by electronic organs. The pedal keyboard includes aplurality of pedal keys having different pitches (sound pitches)assigned respectively thereto. In order to enable a user to improve hisor her skill for performing the pedal keyboard, it is required toprovide the user with a performance guide for the pedal keyboard inaddition to a performance guide for the manual keyboard. However, thepedal keyboard is located more remote from the eyes of the user than themanual keyboard. Thus, even in a case where the performance guide forthe pedal keyboard is provided using LEDs in a similar manner to theperformance guide for the manual keyboard, it may be difficult for theuser to appropriately know or identify pedal keys to be operated. If theLEDs for the pedal keyboard are provided at positions near the user'seyes, for example, the LEDs and the pedal keyboard are spaced from eachother by a relatively great distance, it may be difficult for the userto associate illuminated LEDs and pedal keys to be operated. If the LEDsfor the pedal keyboard are provided at positions near the pedalkeyboard, on the other hand, it may be difficult for the user to look atthe LEDs. For the foregoing reasons, it tends to be difficult to enablethe user to improve his or her skill for performing the pedal keyboard.

In view of the foregoing prior art problems, it is one of the objects ofthe present invention to provide a performance assistance apparatus andmethod which can assist a human player in performing a foot operatorgroup by use of a structure that is easy for the human player to look atand operate and thereby effectively enables the human player to improvehis or her skill for performing the foot operator group.

In order to accomplish the aforementioned and other objects, theinventive performance assistance apparatus is suited for application toa performance apparatus provided with a foot operator group including aplurality of foot operators that are operable with a foot of a humanplayer and that have different sound pitches assigned respectivelythereto, and the inventive performance assistance apparatus includes: astorage medium storing a program; and a processor for executing theprogram, the processor, when executing the program, configured to: causea display device to display a foot operator image indicative of the footoperator group; acquire model performance data including at leastinformation indicative of a rhythm and a pitch of a foot performancepart to be performed by use of the plurality of foot operators; on thebasis of the information indicative of the pitch of the foot performancepart included in the acquired model performance data, visuallydesignate, on the foot operator image displayed on the display device, aparticular foot operator of the plurality of foot operators thatcorresponds to the pitch; and on the basis of the information indicativeof the rhythm of the foot performance part included in the acquiredmodel performance data, present a rhythm of a sound corresponding to thevisually-designated particular foot operator.

According to the inventive performance assistance apparatus constructedin the aforementioned manner, the foot operator image indicative of thefoot operator group is displayed on the display device, and, on thebasis of the information indicative of the pitch and the rhythm of thefoot performance part, the particular foot operator to be performed isvisually designated (indicated) on the foot operator image and therhythm of the sound corresponding to the particular foot operator ispresented. In this way, the display device can be disposed at a positioneasy for the human player to look at, without being constrained by aphysical position of the foot operator group (such as a pedal keyboard).Thus, the inventive performance assistance apparatus can assist thehuman player in performing the foot operator group, with a structureeasy for the human player to look at. Further, because the human playercan easily grasp, based on the presented rhythm of the sound, a timingwhen he/she should perform the operator, the inventive performanceassistance apparatus can assist the human player in performing the footoperator group, with a structure easy for the human player to look atand operate. Namely, the human player can not only intuitively know oridentify the position of each of the foot operators to be operated, bylooking at the foot operator image, but also easily know, from thepresented rhythm, a rhythm and timing when he/she should perform thefoot operator. In this way, the human player can easily learn how tosuitably operate the foot operator group. Thus, the inventiveperformance assistance apparatus effectively enables the human player toimprove his or her skill for performing the foot operator group.

The disclosure made herein also embraces a method that includes stepscorresponding to the constituent elements of the inventive performanceassistance apparatus set forth above. The method may be arranged as acomputer-implemented method. Also disclosed herein is acomputer-readable, non-transitory storage medium storing a programexecutable by one or more processors for performing the aforementionedmethod.

BRIEF DESCRIPTION OF DRAWINGS

Certain embodiments of the present invention will hereinafter bedescribed in detail, by way of example only, with reference to theaccompanying drawings, in which:

FIG. 1 is a block diagram illustrating an example of a hardwareconstruction of an electronic musical instrument provided with anembodiment of the inventive performance assistance apparatus;

FIG. 2 is a schematic diagram explanatory of a specific example of eachof a manual keyboard and a pedal keyboard that constitute a performanceoperator unit, and a guide section;

FIG. 3 is a diagram illustrating an example of a training screendisplayed on a display;

FIG. 4 is a diagram illustrating another example of rhythm information;

FIG. 5 is a diagram illustrating a further example of rhythminformation;

FIGS. 6A to 6C are diagrams illustrating some examples of rhythmpatterns;

FIGS. 7A and 7B are diagrams illustrating some examples of a train ofnotes in a pedal performance part;

FIG. 8 is a block diagram illustrating a functional configuration of theperformance assistance apparatus;

FIG. 9 is a flow chart illustrating an example of a portion of trainingprocessing performed in the performance assistance apparatus;

FIG. 10 is a flow chart illustrating an example of the remaining portionof the training processing performed in the performance assistanceapparatus;

FIG. 11 is a flow chart illustrating an example of rhythm informationgenerating processing; and

FIG. 12 is a diagram illustrating a performance apparatus includinganother type of foot operator group.

DETAILED DESCRIPTION

Construction of Electronic Musical Instrument

FIG. 1 is a block diagram illustrating an example of a hardwareconstruction of an electronic musical instrument 1 provided with anembodiment of the inventive performance assistance apparatus 100. Theelectronic musical instrument 1 of FIG. 1 is an electronic keyboardmusical instrument capable of performing music pieces. As an operationmode of the electronic musical instrument 1, a training mode isavailable for executing music performance training by use of a functionof the performance assistance apparatus 100 incorporated in theelectronic musical instrument 1.

The electronic musical instrument 1 includes a performance operator unit2, an input I/F (interface) 3, a setting operator unit 4, a detectioncircuit 5, a display 6, a display circuit 7, and a guide section 8. Theperformance operator unit 2 is connected to a bus 19 via the input I/F3. Performance data are input to the electronic musical instrument 1 bya user operating the performance operator unit 2. The performance dataare, for example, in the form of MIDI (Musical Instrument DigitalInterface) data or audio data. In the illustrated example, theperformance operator unit 2 includes a manual keyboard HK (manualoperator group) suited for operation with user's (human player's) handsand a pedal keyboard PK (foot operator group) suited for operation witha foot or feet of the user. Details of the manual keyboard HK and pedalkeyboard PK will be set forth later. In addition to the manual keyboardHK and pedal keyboard PK, a modulation wheel, a pitch bend wheel pitchbend wheel, and the like may be provided as the performance operatorunit 2.

The setting operator unit 4 includes an ON/OFF operation switch, arotationally operable rotary encoder or a slidingly operable linearencoder, and the like, and this setting operator unit 4 is connected tothe bus 19 via the detection circuit 5. The setting operator unit 4 isused to execute sound volume adjustment, turning-ON/OFF of a powersupply, and various other settings. The display 6 is a display devicegenerally known as a peripheral device of a computer or the like andincludes a flat screen having a necessary and sufficient area. Thedisplay 6 includes, for example, a liquid crystal display and isconnected to the bus 19 via the display circuit 7. Various informationrelated to a performance, settings, and the like is displayed on thedisplay 6. At least portions of the setting operator unit 4 and display6 may be constituted by a touch panel display. As generally known, thedisplay 6 is disposed at a position (for example, at an eye levelposition) that is easy for the user (human player) to look at. Namely,the position of the display 6 is not constrained by a physical positionof the pedal keyboard PK. The guide section 8 guides the user or humanplayer in a performance executed using the performance operator unit 2.Details of the guide section 8 will be set forth later.

The electronic musical instrument 1 further includes a RAM (RandomAccess Memory) 9, a ROM (Read-Only Memory) 10, a CPU (Central ProcessingUnit) 11, a timer 12, and a storage device 13. The RAM 9, ROM 10, CPU11, and storage device 13 are connected to the bus 19, and the timer 12is connected to the CPU 11. External equipment, such as an externalstorage device 15, may be connected to the bus 19 via a communicationI/F (interface) 14. The RAM 9, ROM 10, CPU 11, and timer 12 togetherconstitute a computer.

The RAM 9, which is for example a volatile memory, is used as a workingarea for the CPU 11 but also temporarily stores various data. The ROM10, which is for example a non-volatile memory, has stored thereincomputer programs (application programs), such as control programs andthe performance assistance program. The CPU 11 performs later-describedperformance training processing by executing on the RAM 9 theperformance assistance program stored in the ROM 10. The timer 12 givestime information, such as a current time, to the CPU 11.

The storage device 13 includes any of storage media, such as a harddisk, an optical disk, a magnetic disk, and a memory card, to storemusic piece data sets of a plurality of practice music pieces. Each ofthe sets of practice music piece data (music piece data sets) includes aplurality of part data corresponding to a plurality of performanceparts. Each of the part data, which is for example in the form of MIDIdata, includes a plurality of event data indicative of a train ofpitches, note-on and note-off time points, velocities, and the like ofthe corresponding performance part.

The aforementioned performance assistance program may be stored in thestorage device 13. Similarly to the storage device 13, the externalstorage device 15 includes any of storage media, such as a hard disk, anoptical disk, a magnetic disk, and a memory card. The aforementionedperformance assistance program may be stored in the external storagedevice 15.

The performance assistance program may be stored in a computer-readablestorage medium and supplied in the storage medium to be installed intothe ROM 10 or storage device 13. Further, in a case where thecommunication I/F 14 is connected to a communication network, theperformance assistance program delivered from a server connected to thecommunication network may be installed into the ROM 10 or storage device13. Similarly, at least one of the music piece data sets may be acquiredfrom a storage medium or acquired from a server connected to thecommunication network.

The electronic musical instrument 1 further includes a sound generator16, an effect circuit 17, and a sound system 18. The sound generator 16and effect circuit 17 are connected to the bus 19, and the sound system18 is connected to the effect circuit 17. The sound generator 16generates tone signals on the basis of performance data input via theperformance operator unit 2 and part data of a later-described automaticperformance part. The effect circuit 17 imparts acoustic effects to thetone signals generated by the sound generator 16.

The sound system 18 includes a digital-to-analog (D/A) conversioncircuit, an amplifier, and a speaker. The sound system 18 converts intoan analog sound signal a tone signal supplied from the sound generator16 via the effect circuit 17 and generates a sound based on the analogsound signal. The electronic musical instrument 1 as a whole functionsas a performance apparatus that generates a tone in response to a user'sperformance operation on the performance operator unit 2. Further, inthe electronic musical instrument 1, the display 6, RAM 9, ROM 10, CPU11, and storage device 13 mainly function as the performance assistanceapparatus 100.

Performance Operator Unit and Guide Section

FIG. 2 is a schematic diagram explanatory of a specific example of eachof the manual keyboard HK and pedal keyboard PK constituting theperformance operator unit 2 and the guide section 8. As illustrated inFIG. 2, the manual keyboard HK includes an upper keyboard UK and a lowerkeyboard LK. The upper keyboard UK and lower keyboard LK arepositionally displaced from each other in an up-down direction and in afront-rear direction. More specifically, the upper keyboard UK islocated above the lower keyboard LK and rearward of the lower keyboardLK (namely, located more remote from the user than the lower keyboardLK). The upper keyboard UK is suited mainly for operation with theuser's right hand, while the lower keyboard LK is suited mainly foroperation with the user's left hand. The upper keyboard UK includes aplurality of upper keys k1 having different pitches assignedrespectively thereto, and the lower keyboard LK includes a plurality oflower keys k2 having different pitches assigned respectively thereto.The pedal keyboard PK includes a plurality of pedal keys k3 havingdifferent pitches assigned respectively thereto. Hereinafter, the upperkeys k1 and lower keys k2 will be referred to collectively as manualkeys.

The upper keyboard UK includes, for example, forty-nine upper keys k1(namely, four octaves and one note) or sixty-one upper keys k1 (namely,five octaves and one note). Similarly to the upper keyboard UK, thelower keyboard LK includes forty-nine or sixty-one lower keys k2. Thepedal keyboard PK includes, for example, twenty pedal keys k3 (namely,one octave and eight notes) or twenty-five pedal keys k3 (namely, twooctaves and one note). Generally, the lowest pitch in the pitch range ofthe lower keyboard LK is higher than the lowest pitch in the pitch rangeof the pedal keyboard PK, and the lowest pitch in the pitch range of theupper keyboard UK is higher than the lowest pitch in the pitch range ofthe lower keyboard LK. Further, the pitch range of the pedal keyboard PKis narrower than the pitch range of each of the upper keyboard UK andlower keyboard LK. The respective pitch ranges of the upper keyboard UK,lower keyboard LK, and pedal keyboard PK may be set in advance or may beset as desired by the user.

Further, in the example illustrated in FIG. 2, the guide section 8includes a plurality of upper illumination portions L1 corresponding tothe individual upper keys k1 and a plurality of lower illuminationportions L2 corresponding to the individual lower keys k2. Each of theupper illumination portions L1 and lower illumination portions L2 isconstituted, for example, by an LED (Light Emitting Diode). For example,the individual upper illumination portions L1 are provided on a rearpanel surface portion of the upper keyboard UK in such a manner that theillumination portions L1 adjoin the corresponding upper keys k1 in thefront-rear direction. The individual lower illumination portions L2 areprovided on a panel surface portion located between the upper keyboardUK and the lower keyboard LK in such a manner that the illuminationportions L2 adjoin the corresponding lower keys k2 in the front-reardirection. In the training mode, any one of the upper illuminationportions L1 is illuminated at a time point when the corresponding upperkey k1 should be operated, and any one of the lower illuminationportions L2 is illuminated at a time point when the corresponding lowerkey k2 should be operated. In this way, the user can easily know oridentify the operating time point of each of the upper keys k1 and lowerkeys k2. Note that the guide section 8 may include only one of thegroups of the upper illumination portions L1 and lower illuminationportions L2. In such a case, the guide section 8 guides the user in aperformance on only one of the upper keyboard UK and the lower keyboardLK.

Training Screen

In the present example, one of the plurality of practice music piecesprepared in advance is selected by the user in the training mode.Further, any of the plurality of performance parts of the selected musicpiece that is to be performed by the user is selected as practiceperformance parts. The practice performance part includes at least oneof a performance part to be performed on the upper keyboard UK(hereinafter referred to as “upper performance part”), a performancepart to be performed on the lower keyboard LK (hereinafter referred toas “lower performance part”), and a performance part to be performed onthe pedal keyboard PK (hereinafter referred to as “pedal performancepart”). Note that at least one of the upper performance part, lowerperformance part, and pedal performance part may be set in advance asthe practice performance part.

In accordance with a progression of the selected music piece (namely, aprogression of an automatic performance sequence), a guide is providedfor assisting the user in performing each of the practice performanceparts. A training screen for guiding the user in a performance on thepedal keyboard PK is displayed on the display 6 of FIG. 1. FIG. 3 is adiagram illustrating an example of the training screen 200 displayed onthe display 6. In FIG. 3, the training screen 200 includes a pedalkeyboard image display region 201 and a rhythm information displayregion 202. A pedal keyboard image PIM corresponding to the pedalkeyboard PK of FIG. 2 is displayed on the pedal keyboard image displayregion 201. The pedal keyboard image PIM of FIG. 3 corresponds to thepedal keyboard PK having twenty keys.

In accordance with the progression of the music piece (namely, theprogression of the automatic performance sequence), the pedal keys k3 tobe operated are sequentially designated on the pedal keyboard image PIM.In the present example, a circular marker MK1 is additionally displayedon the image of the pedal key k3 to be operated. Note that an arrow orthe like pointing to the pedal key k3 to be operated may be additionallydisplayed in place of the marker MK1. In short, in order to designate(or highlight or provide a visual guide for) the pedal key k3 to beoperated, it suffices that a particular icon be additionally displayedin relation to the image of the pedal key k3 to be operated. As anotherexample, a display style of the image of the pedal key k3 to be operatedmay itself be changed in order to designate (or highlight or provide avisual guide for) the pedal key k3. For example, a color of the image ofthe pedal key k3 to be operated may be changed, or the image of thepedal key k3 to be operated may be displayed in a blinking manner.

Rhythm information representing at least a rhythm (in other words, asound generation timing and a time length of a sound) of the pedalperformance part is displayed on the rhythm information display region202 per unit section. A length of the unit section can be expressed inthe number of measures, for example. The length of the unit section maybe variably set by a user or may be a predefined constant length. Here,the rhythm is represented by temporal positions of a plurality ofsounds. A temporal position of a sound (hereinafter referred to as“sound position”) contains a time range from a start of the sound(namely, a note-on time point) to an end of the sound (namely, anote-off time point). In the illustrated example of FIG. 3, the unitsection is a section of one measure, and a rhythm score of one measureincluding a current position of the music piece is displayed as therhythm information. The rhythm score represents a rhythm of the pedalperformance part by symbols of a note and a rest, while a pitch is notrepresented in the rhythm score. Namely, the rhythm is visuallypresented by the sound generation timing and the time length of thesound. Note that the rhythm score may further contain dynamic marks,etc. A marker MK2 indicative of the current position is displayed on therhythm score. In the illustrated example of FIG. 3, it is indicated bythe marker MK2 that the current position is between first and secondbeats. The marker MK2 is moved as the music piece progresses. Once thecurrent position indicated by the marker MK2 reaches an end of the unitsection that is currently displayed, a rhythm score for a next unitsection is displayed in turn. The user may select whether the marker MK2should be displayed or not.

The rhythm information displayed on the rhythm information displayregion 202 is not limited to the rhythm score. In the present example,the user can select, from a plurality of types of rhythm information, adesired type of rhythm information to be displayed. FIGS. 4 and 5 arediagrams each illustrating another example of rhythm information. In theexample of FIG. 4, the rhythm information is a staff notation (bassstaff) for one measure including the current position. According to thestaff notation, a rhythm and a pitch of the pedal performance part arerepresented by symbols of a note and a rest. Namely, the rhythm isvisually presented by a sound generation timing and a pitch and timelength of a sound. Similarly to the example of FIG. 3, the marker MK2indicative of the current position is displayed on the staff.

In the example of FIG. 5, a rhythm screen PR as the rhythm informationis displayed in corresponding relation to the pedal keyboard image PIM.In the rhythm screen PR, a horizontal axis indicates a pitch, and avertical axis corresponds to a time axis. In the rhythm screen PR, agraphic image d in a rectangular form is displayed in correspondingrelation to each sound of the pedal performance part. A position of eachgraphic image d in a horizontal direction denotes a pitch of a soundcorresponding thereto. Specifically, for each graphic image d, a pitchassigned to a pedal key k3 located directly below the graphic image dagrees with a pitch of a sound corresponding to the graphic image d. Alength of each graphic image d in a vertical direction denotes a timelength of a sound corresponding thereto, and a position of each graphicimage d in the vertical direction denotes a time position of thecorresponding sound along the time axis. The respective graphic images dmove in a lower direction along with the progression of the music piece.Namely, FIG. 5 shows an example that visually presents the rhythm of thesound by an image identifying a sound generation timing and a timelength of the sound along a time axis.

A sound generation line TL is displayed near to the bottom of the rhythmscreen PR. A distance between the sound generation line TL and eachgraphic image d corresponds to a time length from the current positionto a time point when the corresponding sound is to be performed. Here, aperiod when a particular graphic image d overlaps with the soundgeneration line TL corresponds to a period when a sound corresponding tothe particular graphic image d is to be performed. Namely, at a timepoint (note-on time point) when an operation of any pedal key k3 shouldbe started, a lower end of the corresponding graphic image d reaches tothe sound generation line TL, and thereafter, at a time point (note-offtime point) when the operation of any pedal key k3 should be terminated,an upper end of the corresponding graphic image d reaches to the soundgeneration line TL.

Generally, a bass part is assigned as the pedal performance part. In thebass part, a same pitch (for example, a pitch of a root note of a chord)is often placed in succession. In such a case, a same key k3 isdesignated repeatedly on the pedal keyboard image PIM. Thus, start andend timings of the individual notes are difficult to be identified andconsequently, it tends to be difficult for the user to identify a timingof an operation of a pedal key k3 and a rhythm thereof if the user isinexperienced. Thus, in the illustrated example, the rhythm informationis displayed together with the pedal keyboard image PIM. In such a case,even where a same pitch is repeated in the pedal performance part, theuser can easily identify a timing of an operation of a pedal key k3 anda rhythm thereof.

It should be noted that, in a case where the training screen 200 has asufficient space, in addition to the pedal keyboard image PIM and therhythm information, a music score indicative of a train of notes to beperformed on the manual keyboard HK and/or a chord score and the likemay be displayed on the training screen 200.

To summarize the aforementioned, in examples of FIGS. 3, 4 and 5, eventhough ways of depiction of the time length of note are different fromeach other, every example visually presents (displays) the rhythm of thesound by an image indicative of a time length of a note (namely, a timevalue) of the sound corresponding to the visually-designated particularfoot operator. Particularly, the example of FIG. 3 presents (displays)the image indicative of the rhythm score for a particular performancesection that contains a note of the sound corresponding to thevisually-designated particular foot operator. Further, the example ofFIG. 5 visually presents (displays) the rhythm of the sound by an imagespecifying a sound generation timing and a time length of the soundalong a time axis. Furthermore, every example of FIGS. 3, 4 and 5 isconfigured to cause the display 6 (display device) to display an imagefor presenting the rhythm of the sound corresponding to thevisually-designated particular foot operator. Specifically, as shown inFIG. 3 or FIG. 5, the images the pedal keyboard image PIM (foot operatorimage) and the image for presenting the rhythm of the sound (the imageof the rhythm information display region 202 or the rhythm screen PR)are displayed in parallel with each other on the same display screen ofthe display 6 (display device). In this way, it is achieved such abenefit that the user can recognize clearly at a glance a mutualrelation between a particular pedal key k3 (foot operator) to beperformed and the rhythm (namely, a performance timing) thereof. Morespecifically, as shown in FIG. 3, the rhythm of the sound correspondingto the visually-designated particular foot operator is presented (by themarker MK2) in synchronization with the visual designation (by themarker MK1) of the particular foot operator on the pedal keyboard imagePIM (foot operator image). In this way, it is achieved such a benefitthat the user can more easily recognize clearly at a glance the mutualrelation between the particular pedal key k3 (foot operator) to beperformed and the rhythm (namely, the performance timing) thereof.

Performance Guide Based on Rhythm Pattern

In the present example, even in a case where part data of the pedalperformance part is not included in music piece data of a selected musicpiece, a guide is provided for assisting the user in performing thepedal performance part on the basis of other part data and rhythmpatterns prepared in advance.

FIGS. 6A to 6C shows some examples of the rhythm patterns prepared inadvance. In FIGS. 6A to 6C, every beat position is indicated with adotted line. FIG. 6A shows an example of a basic rhythm pattern in whicha unit of the pattern is composed of one measure and a quarter note isarranged at every beat in four-four time. FIG. 6B shows another exampleof a rhythm pattern in which a unit of the pattern is composed of onemeasure, a quarter note is arranged at every down beat in four-fourtime, and a quarter rest is arranged at every up beat in four-four time.FIG. 6C shows further example of a rhythm pattern in which a unit of thepattern is composed of two measures, a dotted quarter note and an eighthnote are alternately arranged in the first measure of the unit, and twohalf-notes are arranged in the second measure of the unit. There may beprepared in advance further different rhythm patterns such as a rhythmpattern in which one whole note is arranged in one measure, a rhythmpattern in which a plurality of eighth notes are successively arranged,a rhythm pattern of time other than four-four time, a rhythm patternhaving a unit composed of three or more measures, etc. The rhythmpatterns may be stored in the storage device 13 of FIG. 1, for example.The user can select any one of the plurality of rhythm patterns preparedin advance.

Further, a device or circuitry may be provided for detecting a chordfrom part data of at least one part of the selected music piece anddetermining a pitch of the pedal performance part on the basis of thedetected chord. For example, a root note of the detected chord isdetermined as the pitch of the pedal performance part. In such a case,if an on chord (fraction chord) is detected, a pitch of a bass note ofthe on chord (namely, a pitch of a denominator) is determined as thepitch of the pedal performance part. In addition to the root note of thechord or the bass note of the on chord, a pitch of one of other chordconstituent notes of the chord (e.g., pitch of fifth) may be determinedas the pitch of the pedal performance part.

A train of notes in the pedal performance part is defined by theselected rhythm pattern and pitches determined from the chord. FIGS. 7Aand 7B diagrams show some examples of a train of notes in the pedalperformance part. FIG. 7A shows an example of a train of notes in thepedal performance part when the rhythm pattern shown in FIG. 6A isselected. In FIG. 7A, a chord in a first measure is a C major chord anda chord in a second measure is an E minor chord. In this case, a quarternote having a pitch of a root note “C” of the C major chord is arrangedat every beat in the first measure, and a quarter note having a pitch ofa root note “E” of the E minor chord is arranged at every beat in thesecond measure. FIG. 7B shows an example of a train of notes in thepedal performance part when the rhythm pattern shown in FIG. 6B isselected. In FIG. 7B, a chord in a first measure is a C major chord anda chord in a second measure is an E minor chord of an on chord in whicha note “B” is designated as the bass note. In this case, a quarter notehaving a pitch of a root note “C” of the C major chord is arranged atevery down beat in the first measure, and a quarter note having a pitchof the bass note “B” of the on chord is arranged at every down beat inthe second measure.

In order to cause the user to perform on the pedal keyboard PK accordingto such a train of notes as shown FIG. 7A or 7B, respective pedal keysk3 to be performed are sequentially designated on the pedal keyboardimage PIM, and rhythm information corresponding to the selected rhythmpattern is displayed. In a case where such a type of rhythm informationto be presented that includes pitch information (e.g., as shown in FIGS.4 and 5) is selected, rhythm information including pitch informationdetermined on the basis of a chord is displayed as examples shown inFIGS. 7A and 7B.

The length of the unit section of the rhythm information may beautomatically set according to the selected rhythm pattern. For example,in a case where the rhythm pattern like examples shown in FIGS. 6A and 6b in which a unit of the pattern is composed of one measure is selected,the length of the unit section may be set to one measure, and in a casewhere the rhythm pattern like the example shown in FIG. 6C in which aunit of the pattern is composed of two measures is selected, the lengthof the unit section may be set to two measures. Note that, even in acase where part data of the pedal performance part is included in musicpiece data of a selected music piece, in response to a user's request,the guide may be provided for assisting the user in performing the pedalperformance part on the basis of the other part data and rhythm patternsprepared in advance as aforementioned.

Functional Configuration

FIG. 8 is a block diagram illustrating a functional configuration of theperformance assistance apparatus 100. Functions of various sections ofthe performance assistance apparatus 100 illustrated in FIG. 8 areperformed by the CPU 11 of FIG. 1 executing the performance assistanceprogram stored in the Rom 10 or storage device 13. As illustrated inFIG. 8, the performance assistance apparatus 100 includes a music piecedata acquisition section 101, a keyboard image display control section102, a pedal performance data acquisition section 103, a rhythminformation display control section 104, a pitch acquisition section105, a pedal key designation section 106, a manual key designationsection 107, an automatic performance section 108, a setting receptionsection 109, and a time counting section 110.

The music piece data acquisition section 101 acquires a music piece dataset of a music piece selected by the user from among the plurality ofmusic piece data sets stored in the storage device 13. The keyboardimage display control section 102 controls the display circuit 7 todisplay the pedal keyboard image PIM on the display 6.

The pedal performance data acquisition section 103 acquires, as modelperformance data associated with the pedal performance part, pedalperformance data indicative of at least the rhythm of the pedalperformance part (namely, information indicative of the rhythm).According to the present example, in a case where part data of the pedalperformance part is included in the acquired music piece data, the pedalperformance data acquisition section 103 extracts pedal performance datafrom the part data in the music piece data and automatically reproducesthe extracted pedal performance data in accordance with the progressionof the music piece (namely, the progression of the automatic performancesequence) to thereby sequentially acquire the pedal performance dataindicative of the rhythm (namely, information indicative of the rhythm).On the other hand, in a case where part data of the pedal performancepart is not included in the acquired music piece data, the pedalperformance data acquisition section 103 may sequentially acquire thepedal performance data indicative of the rhythm (namely, informationindicative of the rhythm) on the basis of the selected rhythm pattern.The rhythm information display control section 104 controls, on thebasis of the acquired pedal performance data, the display circuit 7 todisplay rhythm information of the pedal performance part on the display6 per unit section.

The pitch acquisition section 105 sequentially acquires, from theacquired music piece data, information indicative of respective pitchesof the pedal performance part, upper performance part and lowerperformance part. For example, the pitch acquisition section 105sequentially acquires, in accordance with the progression of the musicpiece (the progression of the automatic performance sequence), eventdata indicative of respective pitches of the respective parts from therespective part data of the pedal performance part, upper performancepart and lower performance part. It should be noted that, in a casewhere part data of the pedal performance part is not included in theacquired music piece data, the pitch acquisition section 105 may beconfigured to detect a chord from other part data and acquireinformation indicative of a pitch (namely, event data) of the pedalperformance part on the basis of the detected chord. Namely, the pitchacquisition section 105 acquires, at least as model performance dataassociated with the pedal performance part, event data indicative of thepitch of the pedal performance part.

The pedal key designation section 106 visually designates (specifies),on the pedal keyboard image PIM, a particular one of the pedal keys k3to be performed on the basis of the acquired information (event data)indicative of the pitch of the pedal performance part. Namely, themarker MK1 is added to the image of the particular pedal key k3, asillustrated for example in FIG. 3. In this manner, the performanceassistance unique to the present invention is provided which visuallyguides, by use of the pedal keyboard image PIM, the user about theparticular pedal key k3 to be operated for the music piece performance.The manual key designation section 107 designates the upper key k1 andlower key k2 to be operated on the basis of the acquired information(event data) indicative of respective pitches of the upper performancepart and lower performance part. In the illustrated example, the manualkey designation section 107 illuminates one of the upper illuminationportions L1 corresponding to the upper key k1 to which the pitch of theupper performance part indicated by the acquired information (eventdata) is assigned, as well as one of the lower illumination portions L2corresponding to the lower key k2 to which the pitch of the lowerperformance part indicated by the acquired information (event data) isassigned. In this manner, the conventionally known performanceassistance is provided which visually guides the user about theparticular manual key to be operated.

Further, the automatic performance section 108 reproduces an automaticperformance by outputting to the sound generator 16 the part data of atleast one performance part other than the practice performance part fromamong the acquired part data of the plurality of performance parts ofthe selected music piece. The performance part reproduced as theautomatic performance will hereinafter be referred to as “automaticperformance part”. Such an automatic performance part may be selected bythe user or determined in advance. Alternatively, all of the performanceparts other than the practice performance part may be automatically setas the automatic performance parts.

The sequential acquisition of the information indicative of the pitchand rhythm (namely, performance event data) by the pitch acquisitionsection 105 and pedal performance data acquisition section 103 may beexecuted under automatic performance sequence control in accordance witha predetermined or user-set performance tempo. At that time, the pitchacquisition section 105 and pedal performance data acquisition section103 may sequentially acquire the information indicative of the pitch andrhythm (namely, performance event data) at appropriate time points aheadof respective actual sound generation timings as known in the art,because the sequential acquisition of the information indicative of thepitch and rhythm (performance event data) is executed in order toprovide a performance-assisting guide display. The music piece dataacquisition section 101, pitch acquisition section 105 and pedalperformance data acquisition section 103 together function as anacquisition section that acquires model performance data including atleast information indicative of a rhythm and a pitch of a footperformance part to be performed by use of the plurality of footoperators. As conventionally known in the art, a performance tempo ofthe automatic reproduction by the automatic performance section 108 isinterlocked with the above-mentioned performance tempo in the pitchacquisition section 105 and pedal performance data acquisition section103.

The setting reception section 109 receives display settings of thetraining screen as well as various initial settings. The initialsettings include, for example, color (sound color or timbre)designations of the individual performance parts, a designation of aninitial tempo, a selection of a practice performance part, and the like.In a case where the training mode has a plurality of sub-modes, thesetting reception section 109 may receive a selection of any one of thesub-modes as an initial setting. The sub-modes include a sub-mode inwhich the music piece does not progress until the user operates a key tobe operated, a sub-mode in which the music piece progresses irrespectiveof a user's performance, and the like. The display settings of thetraining screen include, for example, a designation of a length of theunit section, a selection of a type of rhythm information to bedisplayed, a selection as to whether the marker MK2 should be displayedor not, and the like.

The time counting section 110 counts a performance time on the basis ofclock signals generated by the timer 12 in accordance with a progressionof a music piece. The current position in the music piece is indicatedby the time counted by the time counting section 110. Note that when amode in which the progression of the music piece is stopped in responseto a user's performance is currently selected as a sub-mode of thetraining mode, the time counting section 110 temporarily stops the timecounting during the entire time period that the progression of the musicpiece is stopped.

Training Processing

FIGS. 9 and 10 show together a flow chart illustrating an example oftraining processing performed by the performance assistance apparatus100. When the training mode is selected, the training processing ofFIGS. 9 and 10 is performed by the CPU 11 of FIG. 1 executing theperformance assistance program stored in the ROM 10 or storage device13.

First, the CPU 11 executes the function of the music piece dataacquisition section 101 to receive a selection of a music piece (stepS1) and read out the music piece data set of the selected music piece(step S2). For example, once the user selects a music piece by operatingthe setting operator unit 4 of FIG. 1, the music piece data set of theselected music piece is read out by the function of the music piece dataacquisition section 101.

Then, the CPU 11 executes the function of the setting reception section109 to receive various initial settings (step S3) and receive displaysettings of the training screen (step S4). Next, the CPU 11 executes thefunctions of the pedal performance data acquisition section 103 andrhythm information display control section 104 to generate rhythminformation by rhythm information generating processing (step S5).Details of the rhythm information generating processing will be setforth later.

Next, the CPU 11 executes the functions of the keyboard image displaycontrol section 102 and rhythm information display control section 104to control the display circuit 7 to display the training screencontaining the pedal keyboard image PIM and rhythm information on thedisplay 6 (step S6). At this time point, any pedal key k3 is not yetdesignated on the pedal keyboard image PIM. Rhythm information of thefirst unit section of the music piece is displayed on the display 6.

Next, the CPU 11 determines whether or not a start of training has beeninstructed (step S7). For example, the setting operator unit 4 mayinclude a start button such that a start of training is instructed bythe user operating the start button.

Step S7 is repeated until a start of training is instructed. Once astart of training is instructed, the CPU 11 executes the function of thetime counting section 110 to start the time counting by the timer 12 ofFIG. 1 (step S8). Further, the CPU 11 executes the function of theautomatic performance section 108 to start reproduction of an automaticperformance on the basis of the part data of the automatic performancepart from among the plurality of part data included in the music piecedata set read out at step S2 (step S9). Further, the CPU 11 executes thefunction of the pitch acquisition section 105 to start acquiring pitchdata from the part data of each of the practice performance parts (stepS10).

Then, the CPU 11 executes the function of the time counting section 110to determine whether or not the training should be ended (step S11). Forexample, once the end time point of the selected music piece arrives, itis determined that the training should be ended. Alternatively, thesetting operator unit 4 may include a stop button such that it isdetermined, in response to the user operating the end button, that thetraining should be ended.

When the training should be ended, the CPU 11 executes the function ofthe automatic performance section 108 to stop the reproduction of theautomatic performance (step S12) and stop the time counting by the timecounting section 110 (step S13). Further, the CPU 11 executes thefunctions of the keyboard image display control section 102 and rhythminformation display control section 104 to control the display circuit 7to stop the display of the training screen on the display 6 (step S14).In this manner, the training processing is ended.

Upon determination at step S11 that the training should not be ended,the CPU 11 executes the function of the rhythm information displaycontrol section 104 to determine whether or not the current position inthe music piece has arrived at the end position of the unit section ofthe music piece (step S15). Upon determination at step S15 that thecurrent position in the music piece has arrived at the end position ofthe unit section, the CPU 11 executes the function of the rhythminformation display control section 104 to update the rhythminformation, displayed on the training screen, with rhythm informationof the next unit section (step S16). If the current position in themusic piece has not reached the end position of the unit section asdetermined at step S15, step S16 is skipped.

Next, the CPU 11 goes to the flow portion of FIG. 10, and executes thefunction of the pitch acquisition section 105 to sequentially acquireevent data (including pitch data) in accordance with performance timingsas well known in the field of automatic performance sequence control,and then the CPU 11 determines whether or not a note-on time point ofthe acquired pitch (namely, note-on event) has arrived (step S21).Namely, if no note-on time point has arrived, steps S22 to S26 to bedescribed below are skipped. Once any note-on time point arrives, theCPU 11 executes the function of the pedal key designation section 106 todetermine whether or not the pitch in question is a pitch of the pedalperformance part (step S22). If the pitch in question is the pitch ofthe pedal performance part, the CPU 11 executes the function of thepedal key designation section 106 to visually designate (specify) on thepedal keyboard image PIM a particular one of the keys k3 thatcorresponds to the pitch in question (step S23). Namely, the marker MK1is added to the image of the particular key k3, as illustrated forexample in FIG. 3.

Upon determination at step S22 that the pitch in question is not a pitchof the pedal performance part, the CPU 11 goes to step S24, where theCPU 11 executes the function of the manual key designation section 107to further determine whether or not the pitch in question is a pitch ofthe upper performance part. If the pitch in question is a pitch of theupper performance part, the CPU 11 executes the function of the manualkey designation section 107 to designate the upper key k1 correspondingto the pitch in question (step S25). More specifically, the CPU 11illuminates the upper illumination portion L1 corresponding to the upperkey k1 having the pitch in question assigned thereto.

If it is determined at step S24 that the pitch in question is not apitch of the upper performance part, the CPU 11 executes the function ofthe manual key designation section 107 to determine that the pitch inquestion is a pitch of the lower performance part. In such a case, themanual key designation section 107 designates the lower key k1corresponding to the pitch in question (step S26). More specifically,the CPU 11 illuminates the lower illumination portion L2 correspondingto the lower key k2 having the pitch in question assigned thereto.

Then, the CPU 11 determines whether or not a note-off time point of anyacquired pitch (namely, note-off event) has arrived (step S27). Oncesuch a note-off time point arrives as determined at step S27, the CPU 11executes the function of the pedal key designation section 106 todetermine whether or not the pitch in question is a pitch of the pedalperformance part (step S28). With a YES determination at step S28, theCPU 11 goes to step S29, where the CPU 11 ends the designation, havingso far been made on the pedal keyboard image PIM, of the pedal keycorresponding to the pitch in question and then reverts to step S11 ofFIG. 9.

Upon determination that the pitch in question corresponding to thenote-off event is not a pitch of the pedal performance part, on theother hand, the CPU 11 goes to step S30, where the CPU 11 executes thefunction of the manual key designation section 107 to determine whetheror not the pitch in question is a pitch of the upper performance part.With a YES determination at step S30, the CPU 11 goes to step S31, wherethe CPU 11 ends the designation of the upper key k1 corresponding to thepitch in question. More specifically, the CPU 11 turns off the upperillumination portion L1 corresponding to the upper key k1 having thepitch in question assigned thereto and then reverts to step S11 of FIG.9.

Upon determination that the pitch in question corresponding to thenote-off event is not a pitch of the upper performance part, namely, ifa NO determination is made at step S30, this means that the pitch inquestion is a pitch of the lower performance part. In such a case, theCPU 11 goes to step S32, where the CPU 11 ends the designation of thelower key k2 corresponding to the pitch in question. More specifically,the CPU 11 turns off the lower illumination portion L2 corresponding tothe lower key k2 having the pitch in question assigned thereto and thenreverts to step S11 of FIG. 9.

FIG. 11 shows a flow chart illustrating an example of rhythm informationgenerating processing carried out at step S5 of FIG. 9. The processingof FIG. 11 may be executed in parallel with the processing of the mainflow as shown in FIG. 9. At steps S41 to S46 and S48 to S51 of FIG. 11,the CPU 11 executes the function of the pedal performance dataacquisition 103. First, at step S41, the CPU 11 determines whether ornot a pedal performance part exists in the music piece selected at stepS1 of FIG. 9. For example, in a case where a pedal performance part isset in advance in the selected music piece or any part of the selectedmusic piece is selected as a pedal performance part by initial settingsat step S3 of FIG. 9, the CPU 11 determines that a pedal performancepart exists in the selected music piece. In such a case, the CPU 11 goesto step S42 to read out part data of the pedal performance part from theselected music piece.

Next, the CPU 11 acquires, as the pedal performance data, informationindicative of individual sound positions (namely, temporal potion orsound generation timing and length) from the read-out part data (stepS43). The individual sound positions are represented by note event dataincluded in the part data, for example. Next, the CPU 11 corrects(quantizes) the acquired sound positions so as to match a predeterminednote unit time (step S44). A note value (time value) to be thepredetermined note unit time may be based on an eighth note, asixteenth-note, a kind of triplet, and the like, which may be selectedby the user upon the initial settings of step S3 of FIG. 9, for example.

Next, the CPU 11 determines whether or not pitch data of the pedalperformance part is necessary for the rhythm information (step S45).For, example, if a type that includes pitch data (e.g., examples ofFIGS. 4 and 5) is selected on the display settings of the trainingscreen at step S4 (FIG. 9) as the type of rhythm information to bedisplayed, the CPU 11 determines that pitch data of the pedalperformance part is necessary for the rhythm information. In such acase, the CPU 11 acquires, as the pedal performance data, pitch datacorresponding to individual sound positions from the read-out part data(step S46). If no pitch data of the pedal performance part is necessaryfor the rhythm information, then the CPU 11 skips step S46. Next, theCPU 11 executes the function of the rhythm information display controlsection 104 to generate the selected type of rhythm information on thebasis of the acquired pedal performance data (step S47), and then theCPU 11 ends the rhythm information generating processing. With theprocessing of step S47, as shown in FIG. 3 or FIG. 5, the image forpresenting the rhythm of the sound (the image of the rhythm informationdisplay region 202 or the rhythm screen PR) is displayed, and the rhythmof the sound is visually presented (displayed) by the image indicativeof the time length of the sound corresponding to the particular pedalkey k3 (foot operator) designated visually on the pedal keyboard imagePIM (foot operator image), and further, the marker MK2 indicative of theperformance progression may be additionally displayed as necessary.

Upon determination at step S41 that no pedal performance part iscontained in the selected musical piece, the CPU 11 receives a selectionof a rhythm pattern (step S48). For example, rhythm scores of variousrhythm patterns such as the examples of FIGS. 6A to 6C are displayed onthe display 6 for the user to select a desired rhythm pattern from amongthe displayed rhythm patterns. The CPU 11 acquires, as the pedalperformance data, individual sound positions of the pedal performancepart on the basis of the selected rhythm pattern.

Next, similarly to the aforementioned step S45, the CPU 11 determineswhether or not pitch data of the pedal performance part is necessary forthe rhythm information (step S50). If pitch data of the pedalperformance part is necessary, as aforementioned, the CPU 11 detects achord from the other part data and determines one or more pitchescorresponding to the individual sound positions (e.g., time positions ofwalking bass sounds) of the pedal performance part from the detectedchord to acquire the determined pitches as the pedal performance data(step S51). If no pitch data of the pedal performance part is necessary,then the CPU 11 skips step S51. Next, the CPU 11 executes the functionof the rhythm information display control section 104 to generate theselected type of rhythm information on the basis of the acquired pedalperformance data (step S52), and then the CPU 11 ends the rhythminformation generating processing. With the processing of step S52, asshown in FIG. 3 or FIG. 5, the image for presenting the rhythm of thesound (the image of the rhythm information display region 202 or therhythm screen PR) is displayed, and the rhythm of the sound is visuallypresented (displayed) by the image indicative of the time length of thesound corresponding to the particular pedal key k3 (foot operator)designated visually on the pedal keyboard image PIM (foot operatorimage), and further, the marker MK2 indicative of the performanceprogression may be additionally displayed as necessary.

Advantages of Embodiment

In the present embodiment of the inventive performance assistanceapparatus 100, one of the pedal keys k3 to be performed is visuallydesignated on the pedal keyboard image PIM, and the rhythm informationindicative of at least the rhythm of the pedal performance part isdisplayed for each predetermined unit section. Thus, by looking at thepedal keyboard image PIM, the user (or human player) can intuitivelyknow or identify the pedal key k3 to be operated, and the user (or humanplayer) can feel the rhythm accurately. Therefore, the user is enabledto easily master appropriate operations of the pedal keyboard PK. Inthis way, the present embodiment of the inventive performance assistanceapparatus can appropriately assist the human player in performing thepedal keyboard PK and thereby effectively enables the human player toimprove his or her skill for performing the pedal keyboard PK.

Further, in the present embodiment of the inventive performanceassistance apparatus, the pitches of the upper performance part andlower performance part are sequentially acquired, and the upper keys k1and lower keys k2 corresponding to the acquired pitches are sequentiallydesignated. Thus, the user can easily know or identify not only thepedal key k3 to be operated but also the upper keys k1 and lower keys k2to be operated. In this way, the user is enabled to improve his or herskill for performing the manual keyboard HK in addition to the skill forperforming the pedal keyboard PK.

Other Embodiments

Although the rhythm information in the above-described embodiment isgenerated before the start of training having been instructed, therhythm information may be generated along with the progression of themusic piece after the start of training having been instructed. Forexample, rhythm information for a next unit section may be generated atthe end time of each unit section or immediately before thereof, and thegenerated rhythm information for the next unit section may be displayedupon the end of each unit section.

Although the manual keyboard HK in the above-described embodimentincludes two rows of keyboards, the upper keyboard UK and lower keyboardLK, vertically divided from each other, the manual keyboard HK mayinclude only one row of keyboard. In such a case, only one performancepart may be selected as a practice performance part of the manualkeyboard HK. Alternatively, one row of keyboard may be made dividableinto a plurality of key regions. For example, such one row of keyboardmay be divided in a left-right direction into a key region for anaccompaniment performance and a key region for a melody performance. Insuch a case, one performance part may be selected for each of the keyregions.

In the training mode, in addition to the guide for the manual keyboardHK and pedal keyboard PK, a guide may be provided for assisting the userin performing other operators of the performance operator unit 2 such asthe modulation wheel, pitch bend wheel pitch bend wheel, and the like.

An automatic accompaniment may be added to the user's performance. Forexample, a chord may be identified on the basis of the user'sperformance on at least one of the lower keyboard LK and pedal keyboardPK, and automatic accompaniment sounds may be output in such a manner asto correspond to the identified chord.

Although in the above-described embodiments, the pedal keyboard PK isused as an example of the foot operator group to be operated with theuser's feet, another type of foot operator group may be used in place ofthe pedal keyboard PK. FIG. 12 is a diagram illustrating a performanceapparatus including such another type of foot operator group. Theperformance apparatus 250 of FIG. 12 includes, as an example of the footoperator group, a plurality of operating pads PA operable with theuser's feet. Different pitches are assigned respectively to theoperating pads PA. In FIG. 12, the pitches assigned to the individualoperating pads PA are indicated on the operating pads PA. In the casewhere the performance apparatus 250 of FIG. 12 is employed, a footoperator group image corresponding to the plurality of operating pads PAis displayed on the display. Further, each operating pad PA to beoperated is designated on the displayed foot operator group image.

Further, another type of manual operator group, including a plurality ofoperating pads that are for example similar to the operating pads ofFIG. 12, may be used in place of the manual keyboard HK. Furthermore, aplurality of virtual operators displayed on a touch display panel may beused as the foot operator group or manual operator group.

In the above-described embodiments, the individual functional sectionsof FIG. 8 are implemented by hardware, such as the CPU 11 of FIG. 1, andsoftware, such as the performance assistance program. Namely, in theembodiment illustrated in FIGS. 1, 9 to 11, and the like, a mainconstruction that implements the inventive performance assistanceapparatus and/or method is provided by the CPU 11 (namely, processor)executing a necessary application program stored in the RAM 9, ROM 10,or storage device 13 (namely, memory). More specifically, the inventiveperformance apparatus includes the processor (CPU 11), and the CPU 11 isconfigured to execute: causing the display device (6) to display thefoot operator image (PIM) indicative of the foot operator group (PK)(operation of step S6); acquiring the model performance data includingat least information indicative of the rhythm and pitch of the footperformance part to be performed by use of the plurality of footoperators (PK) (operations of steps S10, S21, S43 and S49); on the basisof the information indicative of the pitch of the foot performance partincluded in the acquired model performance data, visually designating,on the foot operator image (PIM) displayed on the display device (6), aparticular foot operator of the plurality of foot operators thatcorresponds to the pitch (operation of step S23); and on the basis ofthe information indicative of the rhythm of the foot performance partincluded in the acquired model performance data, presenting a rhythm ofa sound corresponding to the visually-designated particular footoperator (operations of steps S47 and S52). However, the inventiveperformance assistance apparatus is not so limited, and the individualfunctional sections illustrated in FIG. 8 may be implemented by ahardware device designed, using electronic circuitry etc., exclusivelyfor the performance assistance purposes.

Although the embodiments of the present invention have been describedabove in relation to the case where the present invention is applied tothe electronic musical instrument 1 including the display 6, the presentinvention may be applied to an electronic musical instrument connectable(capable of communicating) with an external display device of asmartphone, tablet terminal, or the like. In such a case, the electronicmusical instrument 1 is communicatably connected with the externaldisplay device of the smartphone, tablet terminal, or the like in awireless or wired manner via the communication I/F (interface) 14, andthe pedal keyboard image and the like are displayed on the externaldisplay device by the external display device functioning in a similarmanner to the display 6 shown and described in relation to theabove-described embodiments.

According to one aspect of the aforementioned embodiment, theperformance assistance apparatus includes: a display control sectionthat causes a display device to display a foot operator image indicativeof the foot operator group; an acquisition section that acquires modelperformance data including at least information indicative of a rhythmand a pitch of a foot performance part to be performed by use of theplurality of foot operators; a designation section that, on the basis ofthe information indicative of the pitch of the foot performance partincluded in the acquired model performance data, visually designates, onthe foot operator image displayed on the display device, a particularfoot operator of the plurality of foot operators that corresponds to thepitch; and a rhythm presentation section that, on the basis of theinformation indicative of the rhythm of the foot performance partincluded in the acquired model performance data, presents a rhythm of asound corresponding to the visually-designated particular foot operator.

According to another aspect of the aforementioned embodiment, the rhythmpresentation section may display the image as a rhythm score for aparticular performance section that contains a note of the soundcorresponding to the visually-designated particular foot operator. Insuch a case, the human player can easily know a rhythm and timing whenhe/she should perform the foot operator by looking at the rhythm score.

According to further aspect of the aforementioned embodiment, theperformance apparatus may further include a manual operator groupincluding a plurality of manual operators that are operable with a handof the human player and that have different pitches assignedrespectively thereto, and the model performance data may further includeinformation indicative of a pitch of a manual performance part to beperformed by the manual operator group. The performance assistanceapparatus may further include a manual operator designation sectionthat, in accordance with the information indicative of the pitch of themanual performance part included in the model performance data,designates a manual operator of the plurality of manual operators thatcorresponds to the pitch indicated by the information. In this case, thehuman player can easily know a manual operator to be operated as well asthe foot operator to be operated. Thus, the human player is enabled tosimultaneously improve the skill for performing both of the manualoperator group and foot operator group.

According to further aspect of the aforementioned embodiment, the manualoperator group may be a manual keyboard that includes, as the pluralityof manual operators, a plurality of manual keys having a plurality ofpitches, constituting a chromatic scale, assigned respectively thereto,and the foot operator group may be a pedal keyboard that includes, asthe plurality of foot operators, a plurality of pedal keys having aplurality of pitches, constituting a chromatic scale, assignedrespectively thereto. In this case, the performance assistance apparatuseffectively enables the human player to improve his or her skill forperforming the pedal keyboard in an electronic musical instrument astypified by an electronic organ.

The foregoing disclosure has been set forth merely to illustrate theembodiments of the invention and is not intended to be limiting. Sincemodifications of the disclosed embodiments incorporating the spirit andsubstance of the invention may occur to persons skilled in the art, theinvention should be construed to include everything within the scope ofthe appended claims and equivalents thereof.

What is claimed is:
 1. A performance assistance apparatus forapplication to a performance apparatus provided with a foot operatorgroup including a plurality of foot operators that are operable with afoot of a human player and that have different pitches assignedrespectively thereto, the performance assistance apparatus comprising: astorage medium storing a program; and a processor for executing theprogram, the processor, when executing the program, configured to: causea display device to display a foot operator image indicative of the footoperator group; acquire model performance data including at leastinformation indicative of a rhythm and a pitch of a foot performancepart to be performed by use of the plurality of foot operators; on thebasis of the information indicative of the pitch of the foot performancepart included in the acquired model performance data, visuallydesignate, on the foot operator image displayed on the display device, aparticular foot operator of the plurality of foot operators thatcorresponds to the pitch; and on the basis of the information indicativeof the rhythm of the foot performance part included in the acquiredmodel performance data, present a rhythm of a sound corresponding to thevisually-designated particular foot operator.
 2. The performanceassistance apparatus as claimed in claim 1, wherein the processor isconfigured to visually present the rhythm of the sound by an imageindicative of a time length of the sound corresponding to thevisually-designated particular foot operator.
 3. The performanceassistance apparatus as claimed in claim 2, wherein the image indicativeof the time length of the sound is displayed as a rhythm score for aparticular performance section that contains a note of the soundcorresponding to the visually-designated particular foot operator. 4.The performance assistance apparatus as claimed in claim 1, wherein theprocessor is configured to visually present the rhythm of the sound byan image specifying a sound generation timing and a time length of thesound along a time axis.
 5. The performance assistance apparatus asclaimed in claim 1, wherein the processor is configured to cause thedisplay device to display an image for presenting the rhythm of thesound corresponding to the visually-designated particular foot operator.6. The performance assistance apparatus as claimed in claim 5, whereinthe foot operator image and the image for presenting the rhythm of thesound are displayed in parallel with each other on a display screen ofthe display device.
 7. The performance assistance apparatus as claimedin claim 1, wherein the processor is configured to present the rhythm ofthe sound corresponding to the visually-designated particular footoperator in synchronization with the visual designation of theparticular foot operator on the foot operator image.
 8. The performanceassistance apparatus as claimed in claim 1, wherein the foot operatorgroup provided in the performance apparatus is a pedal keyboard, and theprocessor is configured to cause the display device to display an imageindicative of the pedal keyboard as the foot operator image.
 9. Theperformance assistance apparatus as claimed in claim 1, wherein theperformance apparatus further includes a manual operator group includinga plurality of manual operators that are operable with a hand of thehuman player and that have different pitches assigned respectivelythereto, wherein the model performance data further includes informationindicative of a pitch of a manual performance part to be performed byuse of the manual operator group, and wherein the processor is furtherconfigured to, in accordance with the information indicative of thepitch of the manual performance part included in the model performancedata, designate a manual operator of the plurality of manual operatorsthat corresponds to the pitch indicated by the information.
 10. Theperformance assistance apparatus as claimed in claim 9, wherein themanual operator group is a manual keyboard that includes, as theplurality of manual operators, a plurality of manual keys having aplurality of pitches, constituting a chromatic scale, assignedrespectively thereto, and the foot operator group is a pedal keyboardthat includes, as the plurality of foot operators, a plurality of pedalkeys having a plurality of pitches, constituting a chromatic scale,assigned respectively thereto.
 11. The performance assistance apparatusas claimed in claim 1, which includes the display device providedtherein.
 12. The performance assistance apparatus as claimed in claim 1,which includes a communication interface such that the performanceassistance apparatus is capable of communicating with the display deviceprovided outside the performance assistance apparatus.
 13. Acomputer-implemented performance assistance method for application to aperformance apparatus provided with a foot operator group including aplurality of foot operators that are operable with a foot of a humanplayer and that have different pitches assigned respectively thereto,the performance assistance method comprising: causing a display deviceto display a foot operator image indicative of the foot operator group;acquiring model performance data including at least informationindicative of a rhythm and a pitch of a foot performance part to beperformed by use of the plurality of foot operators; on the basis of theinformation indicative of the pitch of the foot performance partincluded in the acquired model performance data, visually designating,on the foot operator image displayed on the display device, a particularfoot operator of the plurality of foot operators that corresponds to thepitch; and on the basis of the information indicative of the rhythm ofthe foot performance part included in the acquired model performancedata, presenting a rhythm of a sound corresponding to thevisually-designated particular foot operator.
 14. The performanceassistance method as claimed in claim 13, wherein the rhythm of thesound corresponding to the visually-designated particular foot operatoris visually presented the rhythm of the sound by an image indicative ofa time length of the sound corresponding to the visually-designatedparticular foot operator.
 15. The performance assistance method asclaimed in claim 14, wherein the image indicative of the time length ofthe sound is displayed as a rhythm score for a particular performancesection that contains a note of the sound corresponding to thevisually-designated particular foot operator.
 16. The performanceassistance method as claimed in claim 13, wherein the rhythm of thesound corresponding to the visually-designated particular foot operatoris presented in synchronization with the visual designation of theparticular foot operator on the foot operator image.
 17. The performanceassistance method as claimed in claim 13, wherein the foot operatorgroup provided in the performance apparatus is a pedal keyboard, and thefoot operator image is an image indicative of the pedal keyboard.
 18. Anon-transitory machine-readable storage medium containing a programexecutable by a processor to perform a performance assistance method forapplication to a performance apparatus provided with a foot operatorgroup including a plurality of foot operators that are operable with afoot of a human player and that have different pitches assignedrespectively thereto, the performance assistance method comprising:causing a display device to display a foot operator image indicative ofthe foot operator group; acquiring model performance data including atleast information indicative of a rhythm and a pitch of a footperformance part to be performed by use of the plurality of footoperators; on the basis of the information indicative of the pitch ofthe foot performance part included in the acquired model performancedata, visually designating, on the foot operator image displayed on thedisplay device, a particular foot operator of the plurality of footoperators that corresponds to the pitch; and on the basis of theinformation indicative of the rhythm of the foot performance partincluded in the acquired model performance data, presenting a rhythm ofa sound corresponding to the visually-designated particular footoperator.